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Estimation of contract completion and attrition rates 




Glossary of terms 



Collection - refers to the National Apprentice and Trainee Collection, a set of data that is submitted 
quarterly by the state and territory training authorities to NCVER. The data are cumulative from a set 
point in time (currently data are submitted from 1 July 2002 to the current date). Collections are 
numbered sequentially from the first collection submitted to NCVER in 1994. 

Reporting lag — the delay in time between an event (commencement, completion, ...) occurring and the 
reporting of that event to NCVER via the state and territory training authority data submissions. 

Commencement — refers to the start of a contract of training. The commencement date is the actual 
date an apprentice or trainee commenced training under a training contract. 

Completion — refers to a contract of training in which all of the prescribed requirements have been met. 

Completion Rate — the proportion of completions resulting from a given set of commencements. 

Attrition — refers to a contract of training which ends before the term of the contract has expired - i.e. 
cancelled, withdrawn or transferred. 

Attrition Rate — the proportion of attrition resulting from a given set of commencements. 

Outcome — since the method is the same for completion and attrition, this note uses "outcome" as a 
generic term. The reader may substitute either "completion" or "attrition" for outcome as appropriate. 

Rate to date — term used for calculated outcome proportions when the commencement year is too 
recent to allow enough time for the commencing contracts to have outcomes in sufficient numbers. 

Other terms related to 2009 Apprentice and Trainee Annual — see the supporting documents at 
<http:/ / www.ncver.edu.au/ publications/2263.html>. 
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Completion and Attrition Rates 



Introduction 

Apprentice and trainee data are reported by the State and Territory Training Authorities to NCVER on a 
quarterly basis, starting at the September quarter of 1994. The set of data submitted that quarter is referred 
to as the National Apprentice and Trainee Collection 1. The sets of data submitted in subsequent quarters 
are referred to as Collection 2, Collection 3 and so on. At the time of writing, the set of data being 
submitted is for the March 2010 quarter and is referred to as Collection 63. The data consists of 
information about the contracts of training entered into by apprentices and employers. 

The demand for information on the proportion of apprenticeships that result in successful completions 
and the proportion of apprenticeships that result in cancellations or withdrawals (i.e. attrition) has grown 
over recent years. The obvious way to determine these proportions is to track each contract from its 
commencement and check if it has resulted in an outcome or not. If the contract has an outcome, it will 
be either a completion or attrition (i.e. a cancellation or withdrawal). This principle is sound and has been 
used in the past by considering cohorts of contracts that commence in a given year. 

For contracts that commence in a given time period (usually calendar year), the proportions of attrition and 
completion can be calculated at any subsequent point in time. Clearly, enough time must pass since the 
commencement period in order for the proportions to approximate the completion and attrition rates of 
the commencing cohort. Although attrition can occur at any time after commencement, completion 
implies meeting all contract requirements and this generally requires a specified time in training. 

In addition to having to wait for enough attrition and completion to occur, there is an additional time lag 
involved in reporting these events to NCVER. The effect of these reporting lags is such that the 
completions that occur in a given quarter might take about a year or more to be fully reported. For 
attrition, this is closer to two years. 

The cohort method mentioned above is therefore restricted to cohorts of contracts that commence far 
enough back in time that the calculated proportions approximate valid rates and the reporting delays are no 
longer relevant. Of these two factors, it is the effect of reporting delays that can be reduced. The National 
Apprentice and Trainee Collection calculates estimates of commencements, completions, cancellations and 
withdrawals for time periods deemed to be affected by reporting delays. If these estimates are used to 
calculate proportions, then it should be possible to consider commencements from more recent years than 
would otherwise be the case. 

When considering the more recent commencement years, the more likely it is that not enough time has 
elapsed for the proportions completed or for the proportions of attrition to be considered as "final" rates. 
In this situation, the proportions are just the "rate to date" and can be expected to change appreciably as 
time passes. If, for a given commencement year, the proportion of contracts still "in training", or yet to 
report valid outcomes, is high, compared to previous commencement years, then this indicates that more 
time needs to pass before the calculated proportions of completion or attrition can be considered as valid 
estimates of the corresponding rates. 

The remainder of this document details the method adopted by NCVER to calculate the proportions of 
attrition and completions that was first used in the 2009 Apprentice and Trainee Annual publication. The 
next section describes the method in overview and the following section describes the method in detail. 
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Description of the method 

As mentioned above, NCVER calculates estimates of commencements, completions, cancellations and 
withdrawals when it deemed that the corresponding counts are affected by reporting delays. Details on the 
estimation methodology can be found at <http://www.ncver.edu.au/publications/2267.html>. The key 
outcome from the estimation process is that each record on the Apprentice and Trainee database has a 
weight associated with it. The meaning of the weight is best explained by way of an example. 

Suppose the Apprentice and Trainee database contains 100 completion records in a given state/territory 
for a given quarter. Suppose further that it is estimated that 150 completions actually occurred, that is 
another fifty completions that are yet to be reported. The ratio of actual completions to reported 
completions is 150/100 = 1.5. This ratio is the weight that is associated with each of the 100 reported 
completions in the database. The estimate can be reconstructed from the database by adding the weights 
associated with each of the 100 records in the database. 

Similarly, records on the database that relate to other quarters, states/territories and events (i.e. 
commencements, cancellations, etcetera) will have specific weights associated with them and estimates can 
be reconstructed as above. Where the records in the database are associated with time periods deemed to 
be no longer affected by reporting delays, the actual number of events is estimated by the number of 
reported events and so the weight for each of these records is one. 

The method applies exactly the same way to completions as it does to attrition. Therefore the following 
discussion will refer to “outcomes” with the intent that it can be read as either completions or attrition. 

Table 1 illustrates the information in the database from the present quarter back to some past quarter 
designated as quarter zero. 

Table 1: Reported commencements and outcomes. 
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In table 1, 

X; is the number of reported commencements in quarter i 

Yy is the number of reported outcomes in quarter j that had a commencement in quarter i 
Y+j is the number of reported outcomes in quarter j 

Yj j+ is the number of reported outcomes that had a commencement in quarter i. 

Table 2 illustrates the estimates available for the same period as in table 1. In table 2, 

X i is the estimated number of actual commencements in quarter i 
y.j is the estimated number of actual outcomes in quarter j 



Table 2: Estimated commencements and outcomes - margins. 
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In order to calculate the proportions of outcomes by commencement years, estimates are required for the 
cells in the body of the table. These estimates are obtained by pro-rating the estimated number of 
outcomes across the rows of the table in the same proportions as the columns of table 1. Therefore the 
estimate for the cell representing commencement quarter i and termination quarter j is therefore 

y>j = y*.i (Y ij/Y +ij ) . 
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This means the cells of table 2 can be calculated, giving table 3 below. 



Table 3: Estimated commencements and outcomes - full table. 
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For any given commencement year there are now estimates for the number that resulted in an outcome by 
how many quarters after commencement as well as overall. The estimates in this table are aggregated into 
years of commencement (rows) however the columns of the table have to be slightly altered to represent 
the number of quarters until an outcome instead of the actual quarter of the outcome. This leads to the 
estimates as shown in table 4 



Table 4: Estimated commencements and outcomes - annual table. 
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In Table 4, Wi is the sum of the four Xj 's that are associated with the quarters of the "i th " year. For 
example, Wo = Xo + Xi + Xz + Xs . 

Ei.j is the sum of all the yw that are associated with commencing in the " i th " year and resulted in outcome 
within j quarters of commencing. For example, Eo.o = yo.o + iju + 1 ) 2,2 + . 

For commencement year "i", the estimate of the proportion of contracts that have resulted in outcome is 
Ei.t / Wi . Similarly, the estimate of the proportion of contracts that have resulted in outcome within "j" 
quarters of commencing is (Ei.o + Eu + Z \ ,z + ... + Eij ) / Wi . 
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Practical considerations 

The preceding section shows how to calculate estimated outcome proportions for any given 
commencement year. These estimated proportions can only be treated as meaningful if enough time has 
passed since commencement to allow for the outcomes to occur. There is no rule which guarantees when 
enough time has passed so some judgement is required. 

Historically, outcome rates have remained at about the same level, except when the number of 
commencing contracts being considered is small. If the outcome rate for a given year is much lower than 
the equivalent rate for previous years then this is an indication that more time is required for that rate to be 
treated as a valid estimate. 

This indication is reinforced if the proportion of "unaccounted" contracts is much larger than for the 
previous years. The proportion of unaccounted contracts is simply one minus the sum of the completion 
and attrition rates. Unaccounted contracts include those yet to report a valid outcome and those still 
training. 

Overall, the data quality is adequate for the application of this method. There is a small number of 
contracts that have different values for some data items on their commencing and outcome records. 
These records were "cleaned" by ensuring that the values on the commencement record were used for the 
outcome record. For example, where outcome rates are calculated "by ANZSCO", it is referring to the 
ANZSCO recorded on the commencements. 

The inclusion of transfers as a component of attrition will become an issue as the use of the category 
increases. There is an inconsistency between jurisdictions which affects whether a contract needs to 
transfer to a new contract or not. If an apprentice needs to change employer, some jurisdictions can keep 
the same contract and just amend the employer field. Other jurisdictions must end the existing contract 
and start a new one. The solution to this problem is to "clean" the data before applying the method. 
Reliable procedures need to be developed to link the contracts involved in the transfer and create one 
"derived contract" which can be used instead of the linked contracts. The method can then be applied as 
described above. 
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